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ASSESSING INSTRUCTIONAL CLIMATE: 



DEVELOPMENT OF THE CLASS ACTIVITIES QUESTIONNAIRE 1 



INTRODUCTION 

Instructional climate is an aspect of environmental press defined 
by the characteristic demands of the classroom environment as perceived 
by the students to whom they are directed. The concept of environmental 
press was described in 1938 by Henry Murray, from the characteristic 
modes of response of individuals are inferred needs whose strength and 
relationships characterize the personality. In a similar way the 
strengths and relationships of characteristic stresses, pressures, re- 
wards, and other influences of the environment compose the environmental 
press. 

In 1956 Stern, Stein, and Bloom elaborated the environmental press 
concept by applying it to assessment studies and showing that an im- 
provement in the prediction of performance was possible by defining 
the psychological demands of the situation in which the performance 
takes place. The College Characteristics Index developed in 1957 by 
Pace and Stern applied the concept of environmental press to college at- 
mospheres. More recently Sinclair developed the Elementary School En- 
vironment Survey for identifying various aspects of environmental press in 
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elementary schools. Walberg and Anderson (1968) have shown that measures 
of student perception of classroom environment predict gains in cognitive, 
affective, and behavioral learning criteria, even after differences in 
achievement, interest in the subject, and IQ are extracted. 

At this point the literature merges with another series of studies 
concerning the teacher's effect on classroom climate, i/alberg (1969) 
has shown that the teacher's personality and attitudes influence the climate 
of the classroom. More specifically, Gallagher (1963) has pointed out 

the "crucial role played by the teacher as the initiator and determiner 

2 

of the kinds of thought processes expressed in the classroom." 

It is recognized that the individual’s perception of the environment 
is in part a response to external press and in part affected by internal 
needs. Thus one way of treating student responses would be to study the 
personal characteristics of respondents and identify students with deviant 
perceptions for counseling and differentiated treatment. Alternately, 
the perceptions of the majority of students could be studied with attention 
focused on the environmental demands and their manipulation to produce 
optimal learning by most students. Anderson, i/alberg and Welch (1969) 
have shown the feasibility of changing classroom environments. 

As Stern (1970) points out, there may be some disparity between the 
perceived situation and the veridical one; however, for the students 
themselves the perception is the reality. The relative influence of the 
teacher and the students or. the instructional climate of the class 
remains an unsolved problem. However, if social behavior, goals, attitudes, 
and interests are in large measure acquired through environmental condition- 
ing, it would seem reasonable to identify the environmental press and 



structure the situation to be more congruent with the purposes of the 
school. This approach is the one taken in the development of the 
Class Activities Questionnaire. 

THE PROBLEM 

This study occurred as part of a large-scale evaluation of the 
state gifted program in Illinois. As this is a large and comprehensive 
program, the variety of different projects developed in local school 
districts is very great indeed. What was needed was a means of 
assessing educationally meaningful dimensions of instructional climate. 

The search for common denominators that reduce instructional programs 
to the same--ur at least comparable--terms led to the identification 
of two promising domains: 

1) The Cognitive Domain--the levels of thinking called for in 
class activities; 

2) The Affective Domain--the social and emotional conditions 
that exist in the classroom. 

One of the most strongly supported systems for classification of 
cognitive operations is that developed by Bloom and his colleagues (1956) . 
While the goals and content of programs are diverse, only a limited 
number of thinking operations are believed to exist. These are implied 
in the class activities students are called upon to perform. By 
identifying general categories of activities emphasized in a particular 
class, one can infer the cognitive processes stressed in that class. 

Another domain which allows comparisons of diverse programs is 
an assessment of the social and emotional conditions that exist in the 
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classroom. Some of these are process factors--the way the group and 
teacher interact and work together, teaching strategies, the norms 
and roles that become defined for all participants Other factors 
have to do with individual and group attitudes and feelings: trust and 

cooperation, warmth and enthusiasm, acceptance and involvement. Still 
other factors have to do with what goals are espoused and how they are 
perceived--what the students and teachei think the class is for, including 
the stresses and pressures exerted by school, home, and peers. 

The decision was made to look at classroom transactions in these two 
domains to see what mental and emotional demands were being made upon 
students. One problem to resolve was how to gather data from actual 
classrooms. The data collection procedure needed to be accurate in 
describing class instruction over time, yet efficient and economically 
feasible. It was judged that the most accurate estimate of cognitive 
emphasis and positive learning environment could be obtained using sensitive 
and perceptive observers who would be in the class frequently and who 
were trained in using systematic procedures to collect the data. This 
procedure is too costly. The training, time, and support demands pro- 
hibit its use. (Not to mention the difficulty of locating qualified 
personnel willing to do this somewhat unrewarding job.) However, two 
sources of untrained observers exist in any classroom: the toacher and the 

students. Some evidence (Ehman 1970, Remmers 1963) indicates that 
students' observations provide an accurate picture of the classroom 
environment. The decision was made to process student observations of 
classroom characteristics, a much more objective form of data than 
self-report information. 
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METHOD 



Description of the Instrument 

The Class Activities Questionnaire (CAQ) is a 25 item instrument 

3 

administered to both students and teacher. It asks students to agree 
or disagree on a four point scale to statements describing general 
kinds of activities which characterize their class These activities 
imply either levels of thinking or affective classroom conditions, 

Each item is paired with another item to compose a factor; sixteen fac- 
tors yield a revealing profile of the class. (Five factors are repre- 
sented by single items. One factor, "Teacher Talk ,T is reported separate- 
ly as well as being used as a component of the "Lecture' factor.) In 
addition, subscores are derived by clustering factors into the four 
dimensions of Lower Thought Processes, Higher Thought Processes, Class- 
room Focus, and Classroom Climate, The cognitive dimensions of Lower 
and Higher Thought Processes represent a dichotomy strongly supported 
in validation studies of Bloom 1 s Taxonomy , The Classroom Focus dimen- 
sion assesses whether the focus is on the teacher as information-giver 
with students having a passive role, or on the students being given an 
active role in the class. The Classroom Climate dimension assesses atti- 
tudes and feelings, such as how relaxed and open the class is and the 
amount of involvement of students in class activities. 

Extensive field testing was used in developing the 25 CAQ items. 
Interviews with students were conducted and revisions made to ascertain 
that words used were understood and statements appropriately interpreted. 

-$- 
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TABLt : 1 



Structure of the Class Activities Questionnaire (CAQ)a 





DIMENSIONS 


FACTORS 


BRIEF DESCRIPTIONS (Items not shown) 


r 






1 . 


Memory: 


Activities calling for recall or recognition 












of information presented. 


.88 




LOWER 












THOUGHT 


2. 


Translation: 


Activities calling for paraphrasing or expressing 






PROCESSES 






information in a different symbolic form. 


.65 




(r = .76) 














3. 


Interpretation : 


Activities calling for recognition of relation- 












ships and seeing implications of information. 


.86 






4. 


Application: 


Activities calling for selection of appropriate 












methods and performance of operations required 












by problem situations. 


.83 




HIGHER 


S. 


Analysis : 


Activities calling for recognition of the struc- 






THOUGHT 






ture of material, including the conditions that 






PROCESSES 






affect the way it fits together. 


.78 




(r = .85) 


6, 


Synthesis : 


Activities calling for the generation of re w 












ideas and solutions. 


.89 






1 . 


Evaluation : 


Activities calling for development and application 












of a set of standards for judging worth. 


.71 






8, 


Discussions : 


Student opportunity for and involvement in 






CLASSROOM 






class discussion. 


.58 




FOCUS 


9. 


Test/Grade Stress: 


High pressure to produce teacher-selected 






{r = .88) 






answers for a grade. 


.89 






10, 


Lecture: 


Teacher role is information-giver with a 












passive, listening role for students. 


.82 






11. 


Enthusiasm: 


Student excitement and involvement in class 












activities . 


.91 






12. 


Independence : 


Tolerance for and encouragement of student 












initiative . 


.85 




CLASSROOM 


13. 


Divergence : 


Tolerance for and. encouragement of many solutions 






CLIMATE 






to problems. 


.70 




(r = .86) 


14. 


Humor: 


Allowance for joking and laughter in the 












classroom. 


.86 






15. 


Teacher Talk: 


Proportion of class time consumed by teacher talk. 


.94 






16. 


Homework: 


Weekly amount of outside preparation for class. 


.87 





3 

The CAQ assesses four major Dimensions of instructional climate, as noted in the left-hand 
column. Bach of these dimensions is composed of a number of Factors which in turn are usually 
represented by several items in the questionnaire. (The Cognitive Dimensions are based on 
Bloom’s Taxonomy.) 
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Grade six was determined to be the lowest grade level at which students 
could understand the items and make th~ judgments called for. Children 
below grade six tended to respond globally, the personality of the 
teacher overriding discriminations of various aspects of the class. In 
addition to field testing with children, the cognitive items were 
classified by judges familiar with Bloom's taxonomy to determine whether 
the items were seen as appropriate for the intended taxonomic categories. 

Some evidence of the accuracy of student observations can be seen 

in responses to the item, "On the average, the teacher talks how much 

of the time: 90%, 75%, 60%, 40%, 25%, 10%?" A study was conducted 

of 32 classes comparing the teachers' and median students' estimates to the 

actual percentage of teacher talk recorded by an observer using Flanders' 

4 

system of classifying verbal interaction. The median student estimate 
was within 5% of the actual talk in almost one-third (50%) of the cases 
and within 10% of the actual talk in 58% of the cases. In contrast to 
this, no teacher estimates were within 5% of the actual amount of talk 
and only 16% of the teachers' estimates fell within 10% of the actual 
talk. A look at discrepancies of over 20% between estimates and actual 
talk is also revealing. Only about one-fifth (21%) of the median student 
estimates were off to this extent with students tending to overestimate, 
but in the same general direction on the scale. Nearly three-fifths (59%) 
of the teachers erred by more than 20% and most greatly underestimated 
--in the opposite direction. For example, in a case where the recorded 
teacher talk was 73%, the teacher estimated 25% and in this case the 
median student estimate was 75%. This simply demonstrates again a known 
fact: it is more difficult to be objective in observing oneself than in 
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observing the activities of others 

The teacher would be a poor source from which to obtain information 
about the actual emphases occurring in the classroom. However, the teacher 
is_ the most direct source from which to obtain data on what is intended to 
be emphasized. It is for this purpose that the teacher is asked to 
respond to the CAQ. The teacher reports his intended emphasis and also 
predicts what the students as a group will say. The teacher can then 
compare these responses with the actual emphasis perceived by students. 

Students are in a much better position to report on the emphasis 
actually given to various class activities. Moreover, the nature of the 
instructional climate depends in part on the way it is perceived by the 
students themselves. Not every student is an accurate observer, however, 
it is the consensus of student judgments that is of concern. A system of 
consensus scoring is utilized rather than using simple mean or median 
scores (except for two estimates: teacher taik and weekly preparation 

time for class). 

Briefly, each of the factors is scored as receiving emphasis in a 
class only if all of the following conditions are met: 

1) Consistency of Response : All Cognitive and Classroom Focus 

factors on the CAQ are composed of pairs of items describing class 
activities. If a student agrees with one of the items, and disagrees 
with the other one, he is inconsistent. Two-thirds of the class must 
be consistent in their answers to the pair in order to accept that 
factor for scoring. 

2) Direction of Response: If two-thirds of the class show consis- 

tency of response, half the class or more must hold the i, te opinion 



about a factor for it to be scored as characteristic of the class. 

3) Strength c f Res pons e: If a factor is seen as characteristic 

of the class, it is scored as receiving Some or Much emphasis depending 
on the strength of response indicated by the mean A factor is scored 
cs receiving No emphasis if students as a group disagreed with the pair 
of items Such a score says in eftect that a factor was de-emphasi zed 
--it was clearly not characteristic of the class All factors which do 
not meet the above criteria a r e simply scored Inc one lu s ive , 

The development and pairing of items and conventions established 
for administration and scoring were accomplished by repeated field 
testing, analysis, and revision over a period of months^ The instrument 
v/as determined to supply meaningful information for grade six and above. 
Sample 

The sample used for this study consisted of 131 Illinois classes 
in language arts, science, mathematics and social studies, grades 6 to 12. 
The 41 male and 52 female teachers included in the sample varied ±n age, 

1 raining, and teaching experience They were assured that their identity 
would not be disclosed. The 3,138 students responded anonymously 
during one of their regularly scheduled class periods. 

One group of 62 classes vere "gifted” classes representative of 
schools participat ing in the Illinois Gifted Program. This sample was 
further divided into 28 "Reimbursement" classes (m districts receiving 
noney from the state to operate gifted programs) and 34 "Demonstration" 
classes { m districts selected by the State to demonstrate exemplary 
programs ) The Reimbursement classes were drawn as a 10* random sample 
of reimbursement districts receiving state funds for more than one year. 
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The Demonstration sample includes all demonstration classes in grades 
6, 7, and 8 in the state. 

A group of 69 "Average" classes, grades 6-12 in all four subject 
areas, were taken as a comparison group with care not to include any 
below average classes. The sample of Average classes does not purport 
to be representative of all non-gifted classes in all settings. The 
Average sample was drawn from three Chicago suburban communities -- 
mainly white, middle-class, socio-economically average or above. A 
separate study (based on data obtained by Hession. 1969) has shown 
that gifted and average students do not respond differently to the CAQ. 

Re liability 

By most methods, reliability is a function of a wide distribution of 
scores, yet the nature of the CAQ operates to produce a low variance in 
a distribution of scores within a given classroom group. Reliability 
coefficients obtained using traditional techniques would be spuriously 
low. Thus, it is not appropriate to estimate reliability according to 
the correlational methods ordinarily used for test analysis. It must 
be remembered that the unit of analysis is the classroom group; thet is, 
certain characteristics of the classroom observed by students. The 
reliability statistic involved here informs of the stability of the 
instrument itself--its objectivity as an observational technique. 

Students are expected to agree about the various characteristics; thus 
the variance within classes is error variance. As the reliability 
statistic reflects the ratio of total variance to true variance, if the 
within class distribution of responses varies more than the distribution 
of all class means, the reliability of the instrument can be questioned. 
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In this study (N = 131 classes] the Horst formula (1949) for estimating 
reliability from the within class and between class variances is used, 
i/iner (1962) treats the same problem and derives essentially the same 
solution. Table 1 shows these reliability estimates for each of the four 
major dimensions as well as each of the 16 individual factors of the CAQ. 
Fourteen of the twenty correlations are above .80 with only one falling 
below .68. 

A second concern regarding the reliability of the instrument has 
to do with the stability of group responses over time. If the instrument 
is assessing characteristics of the class that are general enough to 
be seen as patterns of emphasis over many weeks, then a test-retest 
reliability coefficient should reflect such stability. This is not 
to assume that patterns of emphasis are static, but some stability 
must obtain for an analysis of instructional climate to be meaningful. 

A pilot study has been conducted to explore the stability of 
response over time. Six classes not included in the samples studied 
in this report were administered the CAQ in late May 1970 and the 
same form was readministered two weeks later, one week before the e, \ 
of the school year. Students were not told they would be answering the 
questionnaire a second time and teachers were not shown the CAQ until 
the second administration. It was found that the classes included in 
this pilot study were not typical classes, being quite small and con- 
ducted partially in an independent study mode. For this reason, the 
CAQ was not entirely appropriate as it depends upon a class operating 
as a group; students may have been responding somewhat arbitrarily to 
items irrelevant to their situation. The results of this pilot study 



are thus considered quite tentative. Table 2 allows the test-retest 
reliability coefficients for each of the four dimensions of the CAQ. 



TABLE 2 

Pilot Study Results on the Stability of Class Responses 



(Based on test* 
ranged from 10 


■retest subscore means 
to 18.) 


for six classes . 


Group sizes 




Subscore 1: 
Lower Thought 
Processes 


Subscore 2: 
Higher Thought 
Processes 


Subscore 3: 
Classroom 
Focus 


Subscore 4: 
Classroom 
Cl imate 


.67 


.91 


.59 


.89 



A more extensive study needs to be made, but these results suggest 
reasonably stable perception of instructional climate characteristics. 
Group processing of student judgments appears to be a reliable source 
of information about the classroom. 

P rinciple Component Analysis 

The instrument was developed and used on the basis of a logical de- 
sign, To ascertain the degree to which the data supported this structure, 
a principle component analysis of items 1-25 on the CAQ was conducted. 
Varimax rotation produced ten components accounting for 62% of the 
variance in the sample studied. (N - 2071; this study was conducted 
before results were available for some of the average classes. This 
analysis includes 72 gifted and 16 average classes.) The statistical com- 
ponents provide substantial support for the logical construction of the 
instrument. Table 3 shows the relationship of the statistical components 
to the theoretical structure. Eight of the ten logically paired items 
remained intact in the analysis. The two items in the Evaluation factor 
O 
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TABLE 3 

Relationship of the Statistical Components and 
Logical Factors of the CAQ 



o 
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Statistical Components 



Component 



Component 7 
" Component 5 



Component 3 
’ Component 1 
Component S 

’ Component 1 

Component 9 
Component 10 



{ 

{ 

{ 

{ 

{ 

{ 



Logical Factors and Paired Items 
(Factor loadings and key words in item shown) 

COGNITIVE FACTORS (1-7) 

1. Memory 

1. (.S3) Remember and recognize 

10. (.73) Memorize 

2. Translation 

9. (- . 80) Resta ce ideas 

21. (--45) Explain and su.Tmarize 

■ 2L. ( .43) Explain and summarize 

3^ In terpretation 



6 . 

16. 



(-.71) See implications 

(-.80) Find trends and consequences 



4. Application 

3. (.56) Put methods and ideas to use 

13. (.45) Practice methods *.o solve problems 

5. Analysis 

7. (.73) Logical reasoning and analysis 

12. (.72) Think tnrough complicated problems 

6. Synthesis 

11. (.64f Produce something new 

23. (*'l) Invent, design, compose, create 

7. Evaluation 



2. (.83) Make judgments and explain why 

- 20. (.69) Judge the value of ideas 



— Component 4 

'Component 2 
Component 8- 



{ 

{ 



AFFECTIVE FACTORS (8-16) 

8. Discussion 

5. (-.7C) Actively participate 
15. ( .69) Little opportunity to participate 

(Item reversed) 

9. Test/Grade Stress 

8. (.64) Know the one best answer 

22. (.64) Great concern for grades 

10. Lecture 



. 4. (.93) Do nther things than listen in class 

26. (Not incl. in Factor Analysis) Teacher Talk 

11. Enthusiasm 



Component 4 

| 


r 


-19. 

.19. 


(».6S) Excitement and involvement 
( .43) Excitement and involvement 


Component 1 J 


12. 


Independence 


1 


I 


14. 


(.57) Independently explore and begin 
new activities 




13. 


Divergence 






17. 


Discover many solutions 


Component 6 


14. 


Humor 

-25. (.96) Jokes or laughter in cla:s 




15. 


Teacher Talk 






26. 


(not included in analysis) 




16. 


Homework 

27. (not included ir analysis) 




(Items 


18 and 24 were dropped in final stages of 



field testing, but not deleted from the forj of 
the instrument used in data collection.) 
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fell out as two independent components. Item 21 in the Translation factor 
also has a low leading with Analysis. The cognitive domain received 
strongest support. In relation to the Lower Thought Processes, the class- 
room focus factor, Test/Grade Stress, is seen to be associated with the 
cognitive factor, Memory. It has been found that students interpret one 
of the Memory it sms as rote memory only. This weakens this factor and 
results in an underestimate of the degree to which teachers emphasize the 
recall and recognition aspects of memory. 

Of the four higher thought processes, two (Analysis and Evaluation) 
are shown to be discrete and two (Application and Synthesis) are seen as 
related. The latter are also associated with the two classroom climate 
factors, Enthusiasm and Independence. A1 thought the two items composing 
the Evaluation factor are seen to be discrete statistical components, 

'■'bey are both relevant for and clearly pertain to evaluation. Therefore, 
the pairing of these items was retained, although it is clear they are 
not equivalent in meaning. A search will continue to identify better 
items to strengthen this structure. 

Divergence, one of the four logical factors represented by single 
items on the questionnaire, did not load on any of the statistical com- 
ponents. This would suggest that it does not assess a discrete character- 
istic of the class. Little confidence has bee., placed in the results 
obtained on this item. It is difficult to believe that tolerance for and 
encouragement of many answers is a characteristic of most classrooms, as 
student responses in all groups indicated. 

USES AND LIMITATIONS 

The Class Activities Questionnaire has been found useful in a large- 



scale evaluation comparing many classes. This use is illustrated in the 



findings of the Illinois Gifted Program Evaluation. Similarly, other 
special programs or even grade levels or subject areas in a school system 
could be evaluated. 

A second use of the instrument could be as a tool for the teacher to 
look at his own teaching. Such feedback not only provides some correction 
or support for the observations of the teacher, but offers a framework 
within which to modify instruction. 

There are cautions to observe in using the instrument. First, the 
CAQ can be threatening to the teacher. Care should be taken to reduce this 
threat and to protect the anonymity of both teacher and students. Second, 
the instrument is not appropriate for use in elementary grades. It may 
be difficult for some sixth grades and :‘.s recommended for use in grades 
seven and above. Third, the construction and scoring of the instrument 
is based on group methods of instruction. The CAQ should be used only 
after a group has staoilized and a pattern of emphasis is apparent to 
st dents -- four to six weeks after a course begins. 

The Class Activities Questionnaire makes use of a resource readily 
available but seldom utilized by teachers: the perceptions of students. 

The perceptions called for are low-inference judgments of prevailing pat- 
terns of instructional emphasis. The instrument does not assess all of 
the variables that should be considered in evaluating instruction. This 
is not its intent. It does provide a broad picture of classroom trans- 
actions. It reveals the perceptual reality of the classroom for 
students -- a critical element in learning. The implications of assessing 
instructional climate in this way are extensive. 
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FOOTNOTES 



1 

The work reported here was funded by the Department of Program 
Development for Gifted Children, Office of the Superintendent of Public 
Instruction, Springfield, Illinois. The Gifted Program Evaluation, now 
in its fourth and final year, is administered by the Center for Instruc- 
tional Research and Curriculum Evaluation (CIRCE), University of 
Illinois at Urbana-Champaign. 

2 GALDAGHER, J.J., and JENNE, W. Productive thinking of gifted 
children. Cooperative Research Project Number 965, Urbana, Illinois: 
Institute for Research on Exceptional Children, University of Illinois, 
August 1963, page 10. 

3 

A copy of the CAQ may be obtained by writing to Illinois Gifted 
Program Evaluation, 805 West Pennsylvania Avenue, Urbana, Illinois 61801. 

^The median student estimates show a correlation of .67 (p<.01) 
with the percentage of teacher talk recorded by observers; correlation 
of teacher estimates with observers is .35 (p>.05). 
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PATTERNS OF COGNITIVE AND AFFECTIVE EMPHASIS 
IN GIFTED AND AVERAGE CLASSES 



As part of a large-scale evaluation of the state gifted program in 
Illinois, the systematic processing of low-inference student judgments 
about their classes was used to describe and evaluate classroom trans- 
actions. The purpose of this study was to determine 1) iVhat cognitive 
and affective emphases exist in the classroom, and 2) What patterns dif- 
ferentiate "gifted" and "average" classes? 

The sample used for this study consisted of 131 Illinois classes in 
language arts, science, math, and social studies, grades 6 to 12; 3138 stu- 
dents completed the CAQ. One group of 62 classes were "gifted" classes as 
identified by their school district. This samplo was further divided into 
28 "reimbursement" classes (in districts receiving money from the state to 
operate a gifted program) and 34 "demonstration" classes (in districts selec- 
ted by the state to demonstrate exemplary gifted programs). A group of 69 
"average" classes was taken as a comparison group with care not to include 
any below average classes. A separate study had shown that gifted and aver- 
age students do not respond differently to the CAQ (see Hession paper). The 
average sample was drawn from three Chicago suburban districts -- mainly 
white, middle-class, socio-economically average -- and does not purport to 
be representative of all classes in the state. An analysis of variance 
revealed no differences between the average schools in CAQ scores. 



- 1 - 



21 



( C omparisons Bet we en Gifted and Average C lasses 



How do gifted classes in Demonstration Centers and Reimbursement Pro- 
jects differ from average classes (clashes not designated as honors or 
gifted)? To determine whether differences exist, these three groups of 
classes were compared on summary subscoies based on the four major dimen- 
sions of the CAQ: 

1) Lower Thought Processes 

2) Higher Thought Processes 

3) Classroom Focus 

4) Classroom Climate 

Table 1 shows the differences revealed by this comparison. (Tables 
2 and 3 give the ANOVA and t-test values on which these results are based.) 
Both Reimbursement and Demonstration gifted classes place significantly more 
emphasis on higher thought processes, classroom focus, and classroom climate. 
The degree of emphasis given by average classes on these three dimensions is 
very low. The two groups of gifted classes differed only in the degree to 
which they emphasized positive classroom focus -- active student involve- 
ment in class activities with reduced pressure on tests and grades. Demon- 
stration classes had significantly more positive conditions in this dimen- 
sion than either Reimbursement or Average classes. In fact the degree of 
positive emphasis in the latter two is low, with the trend in Average classes 
being toward a negative classroom focus -- the teacher lecturing and being 
the central figure with little student discussion and much test/grade pres- 
sure. 

It is clear from Table 1 that average classes as a group place little 
emphasis on any of the four dimensions of instructional climate measured 
by the CAQ. In contrast both gioups of gifted classes differ strikingly 
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DIFFERENCES IN INSTRUCTIONAL CLIMATE IN GIFTED AND NON -GIFTED CLASSROOMS IN ILLINOIS 
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r Both Reimbursement and Demonstration classes show almost equal emphasis on both 
higher and lower level thinking abilities, while Comparison classes show less em 
phasis on lower thinking abilities and no emphasis on higher levels. 



TABLE 2 



ANALYSES OF VARIANCE FOR FOUR DIMENSIONS 



Lower Thought Processes Subscore 



Source 


df 


SS 


MS 


F ratio 


Between 


2 


. 14 


.07 


2.44* 


Within 


128 


3.66 


.03 




Total 


130 


3.80 






*p > .05 


(Not Significant) 










Higher Thought Processes 


Subscore 




Source 


df 


SS 


MS 


F ratio 


Between 


2 


2.68 


1.34 


40.29** 


Within 


128 


4.26 


,03 




Total 


130 


6.9S 






**p < ,001 














Classroom Focus Subscore 




Source 


df 


SS 


MS 


F ratio 


Between 


2 


6,03 


3.02 


37.52** 


Within 


128 


10,29 


.08 




Total 


130 


16.32 






**p < .001 














Classroom Climate Subscore 




Source 


df 


SS 


MS 


F ratio 


Between 


2 


4.40 


2 20 


31.64** 


Within 


128 


S. 90 


.07 




Total 


130 


13.30 








**p < .001 
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TABLE 3 



VALUES OF STUDENT'S t COMPARING DIFFERENCES BETWEEN MEANS FOR THE AVERAGE 
. AND GIFTED SAMPLES ON EACH OF THE FOUR CAQ SUBSCORES 

SUBSCORE 1: LOWER THOUGHT PROCESSES 



Comparisons 


df 


Mean 


Difference 
SD Between Means 


t 


Average § Reimbursement 


95 


2.223 


.177 


.053 


1.384 


Average $ Demonstration 


101 


2.214 


.157 


.073 


2.019* 


Reimbursement 6 Demonstration 


60 


2.174 


. 163 


.020 


.482 


SUBSCORE 2 : HIGHER THOUGHT 


PROCESSED 










Average 6 Reimbursement 


95 


2.276 


.188 


.264 


6.643*** 


Average & Demonstration 


101 


2.252 


.145 


.30* 


7.570*** 


Reimbursement & Demonstration 


60 


2.067 


. 197 


.040 


.885 


SUBSCORE 3: CLASSROOM FOCUS 










Average 6 Reimbursement 


95 


2.524 


.265 


.304 


4.593*** 


Average § Demonstration 


101 


2. <*49 


.365 


.495 


9.186*** 


Reimbursement § Demonstration 


60 


2.203 


.242 


.190 


2.454** 


SUBSCORE 4: CLASSROOM CLIMATE 










Average § Reimbursement 


95 


2.212 


.273 


.370 


6.054*** 


Average § Demonstration 


101 


2.190 


.273 


. 365 


6.662*** 


Reimbursement § Demonstration 


60 


1.952 


.236 


.006 


.085 


*p < .05, however ANOVA for 


Subscore 1 


was not 


significant 







**p < .02 
***p <.001 
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from the Average classes sampled here. Gifted classes emphasize most or 
all of the four dimensions measured, 

Within the gifted groups demonstration classes are superior t> reim- 
bursement classes in only one dimension -- classroom focus. This dimen- 
sion has been most emphasized in the selection and training of demonstra- 
tion personnel, That is, classroom focus has been away from the teacher 
lecturing and being the central figure with little student discussion and 
much test/grade stress. Also worth mention is the fact that of the four 
dimensions classroom focus is the easiest to make visible to classroom 
visitors . 

An analysis of variance was also run on the statistical factors with 
the same results. The three groups are significantly different at the .01 
level on Factor 1 (Application, Synthesis, Enthusiasm, and Independence) 
and Factor II (Memory and Test/Grade Stress). The gifted classes are su- 
perior to the average classes on both factors but there is no difference 
between the demonstration and reimbursement classes. 

Are there patterns of emphasis within these four dimensions which 
characterize each sample of classes? The ensuing sections will look spe- 
cifically at the sixteen factors within the four dimensions of the CAQ. 

Patterns of Cognitive Emphasis 

The first two dimensions of the CAQ, Lower and Higner Thought Proces- 
ses, are composed of seven hierarchical levels of thinking based on Bloom's 
Taxonom y r Each higher numbered level includes the lower levels as part of 
the thinking operation. Thus all of the Higher Thought Processes (Applica- 
tion, Analysis, Synthesis, and Evaluation) utilize the Lower Thought Pro- 
cesses (Memory, Translation, Interpretation) in performing the thinking 
operation. The highest level, Evaluation, theoretically could call into 



play all of the other six levels as subordinate processes in the act of 
evaluating, By way of illustration, if a student is expected to know a 
classification system for rock and mineral identification, memorising is 
the end implied by the activity. However, if a student is given a bag 
full of rocks and minerals and is expected to identify them using the 
classification system, application is the end sought. Here memory or 
■call of the classification system serves as a means for efficiently 
identifying the rocks, but not as an end in itself. 

What activities predominate in classrooms? In what percent of average 
classes or gifted classes are activities emphasized which call for each of 
the thinking processes? The CAQ provides only an indication -- a rough 
estimate -- of the focus of emphasis, but it is informative.* 

Table 4 shows the patterns of emphasis which characterize each of 
the three groups of classes. Only these factors which were seen as em- 
phasized (to any degree) by at least 25% of the classes in a group are 
considered to characterize a group. (Emphasis by fewer than 25% of the 
classes is not shown). 

Average classes as a group emphasize three of the seven thought pro- 
cesses. The most common focus of emphasis is on Analysis -- breaking 
things apart into their structural components. (Remember that a particu- 
lar class might have emphasized one of these levels, or two or three, or 
none. It might -- unlike the group as a whole -- have emphasized one or 
more of the other four levels, too.) It should be obvious from this pro- 

*Bear in mind that the lowest level, Memory, as noted by Steele » is 
not adequately assessed by the C£Q. Activities requiring rote memory rather 
than those calling for recall or recognition seems to be assessed. Drill 
and repetitive exercises are activities not fully reflected in the factor 
as presently structured, 
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TABLE 4 



CHARACTERISTIC PATTERNS OF COGNITIVE EMPHfelS If) AVERAGE ANB GIFTED CLASSES 

% of Classes in Each Group Emphasizing Each Level 



Cognitive Levels 


Sample of 
Average Classes 
(N-69) 


Sample of Gifted 
Reimbursement 
Classes 
(N= 28) 


Sample of Gifted 
Demonstration 
Classes 
(N=34) 


1 . 


Memory 


_ _ 


_ _ 


_ _ 


LOWER 










THOUGHT 2. 


Translation 


39% 


57% 


47% 


PROCESSES 










3. 


Interpretation 


30% 


64% 


82% 


4, 


Application 


-- 


43% 


E9% 


HIGHER 5. 


Analysis 


58% 


90% 


74% 


THOUGHT 










PROCESSES 6. 


Synthesis 


-- 


43% 


39% 


7. 


Evaluation 


-- 


25% 


35% 


file that many average classes place little or no emphasis on any 


cognitive 


level . 










Both Reimbursement 


and Demonstration 


Gifted Classes are seen 


as empha- 


sizing 


six of the seven 


cognitive levels - 


■- twice as many as the Average 


classes 


. A greater proportion of classes 


emphasize each level In 


the Gifted 


group. 


In fact, a majority of the gifted 


classes emphasize three 


of the 



seven levels. The pattern of emphasis differs slightly between the Reimburse- 
ment and Demonstration groups. There is a shift upward in Demonstration 
classes toward greater emphasis on higher thought processes. A majority of 
Reimbursement classes emphasize levels 2, 3, and 5 (Translation, Inter- 
pretation and Analysis ). A majority cf the Demonstration classes empha- 
size levels 3, 4, and 5 (Interpretation, Application, and Analysis). 
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V arietie s of Cognitive Emphasis 

The characteristic patterns of emphasis in Average and Gifted classes 
indicate that a s a group a greater proportion of Gifted classes emphasize 
a wider variety of cognitive levels than the Average group of classes. 

But what variety of emphasis occurs in individual classes? Are several 
levels of thinking emphasized in the same classroom? It would seem appro- 
priate for gifted classes to emphasize a greater variety of thought pro- 
cesses than average classes* as veil as emphasizing several of the higher 
levels of thinking. Table 5 shows the number (not the level) of thought 
processes emphasized in classrooms in each group. 

TABLE 5 

TOTAL NUMBER OF THOUGHT PROCESSES EMPHASIZED IN AVERAGE AND GIFTED CLASSROOMS 



% of Classes Emphasizing Each Number of Thought Processes 



Number of Thought 
Processes Emphasized 
By Individual Classes 


Sample of 
Average Classes 
(N-6S) 


Sample of Gifted 
Reimbursement Classes 
(N=28) 


Sample of Gifted 
Demonstration Classes 
(N=34) 


None Emphasized 


13% 


-- 


-- 


1* 


35% 


11% 


9% 


2 


25% 


21% 


21% 


3 


19% 


25% 


23% 


4 


7% 


21% 


26% 


5 


1% 


18% 


12% 


6 


-- 


4% 


9% 


7 


-- 


-- 


-- 



•These numbers do not correspond to the levels of thinking, but only reflect 
how many thought processes are emphasized by individual classes. 
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7 A b l i o 

NUMBER Ot HIGHER itfObGBV f SGCtarfS RMf HASi ZED IN AVERAGE AND GIFTED SAMPLES 



Number ot Higher Thought 
Processes Erapha *i zed 
By Individual Classes 


Sariipie or 
Average Classes 
(N t-9) 


Sample of Gifted 
Re i flebu x s erne n t Classes 
fN r ?S) 


Sample of Gifted 
Demons u icn Cls.se* 
(g;34) 


None Eiflph® sized 


28% 




6% 


1 


S4% 


29^ 


26% 


2 


lt*% 


i9% 


32% 


b 


U 


2i V 


21% 


4 


j \ 


/% 


1 S% 



u un c* that whiic only ‘> 5 % of the Average classes emphasized more than 

one H:rhni ‘ilv^'ghf i" ■: -j; e* s, ci the two Gifted groups emphasized more 

t ha u CTO: 



The s 1 t *. chat ?nd> idual <>i»ed classes emphasize man/ levels 



vt th;'.kxr Nj> K.i.rg tc-eta* fi nder ;hc ;gtu p/a e-ses bhi le this variety 
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Pattern s of Emphasis on Kon^o^n 3 . ti je Classroom Condition s 

The third and fourth dimensions ot the CAQ are Classroom Focus and 
Classroom Climate. Classroom Focus is concerned with the cente, of atten- 
tion and activity --on the teacher or the students Classroom Climate is 
concerned with the openness of the classroom -- the existence of opportu- 
nities and conditions which are motivating and conducive to learning 

Table 7 shows the pattern of emphasis which characterize each of the 
three groups of classes. Again, only those factors winch were seen as em- 
phasized by at least 25% of the classes in a group are shown. 



TABLE 7 

CH ARACTERIST I C PATTE RNS OF E MPHASIS ON CLASSROOM FOC U S AND CLIMATE 
IN AVERAGE AND GIFTED CLASSES 



Class room Condi t ions 
(Factoi s~f rom the 
Class Activities 
Questionnaire) 



% of Class es in Each Group E mpha siz ing Each Factor 



Sample of 
Average Classes 
(N-69) 



Samp 1 e of Gifted 
Reimbursement 
Classes 
28 ) ‘ 



Sample of Gifted 
Demonstration 
Classes 
(N-34) 



8 . Discussion 

CLASSROOM 

FOCUS 9, Test/Grads Stress 

Uh Lecture 



1 1 « Enthusiasm 
(Lack of) 

CLASSROOM 12. Independence 
CLIMATE 

13. Divergence 

(Much Emphasis) 



o 




30% 


89% 


88 % 


25% 


-- 


-- 


28% 


32% 


-- 


-- 


65% 


70% 


(51%) 


(-0 


(-■) 


28% 


71% 


79% 


69% 


96% 


97% 


(--) 


(71%) 


(82%) 


78% 


93% 


8 S% 
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Presence of Humor 



In the Average Sample about as many classes (one-fourth of the group) 
seem to emphasize Lecture as emphasize Discussion. As the next table which 
deals with amount of teacher talk will show, however, the opportunity for 
discussion is limited due to the amount of teacher talk which occurs. The 
classroom focus in Average classes seems clearly on the teacher as informa- 
tion-giver, with a limited amount of active involvement of students. As a 
v roup Average classes are also chai.. _*erized by stress on tests and grades. 

In the Classroom Climate dimension, the most striking characteristic 
of Average classes is the lack of enthusiasm. In less than 25 % of the classes 
are students excited and involved. On the contrary, in over half the Average 
classes students are not just neutral but negative and uninterested in clas° 
activities. As a group Average classes permit some opportunity fcr indepen- 
dence and divergence, however a very high degree of opportunity for divergent 
activities is not characteristic of Average classes. The presence of humor 
and laughter is characteristic of all three groups of classes studied. 

In contrast to the Average group, almost all classes in the two Gifted 
groups emphasize discussion, Gifted students have opportunity and are in- 
volved in discussion. An emphasis on tests and grades is not characteristic 
of gifted classes, For the Reimbursement Gifted classes, lecture is still a 
characteristic of Classroom Focus in addition to the strong emphasis on dis- 
cussion. 

Both groups of Gifted classes are characterized by an extremely positive 
Classroom Climate. In a majority of the gifted classes students are excited 
and involved in class activities. There is opportunity for independent acti- 
vities and much opportunity for divergent activities. As was true in the 
Cognitive dimensions a greater proportio n of the classes in the Gifted groups 
emphasized positive classroom focus and classroom climate than Average classes. 




Teacher Talk 



The percentage of class time consumed by the teacher speaking is in 
itself an index of classroom conditions. The more teacher talk, the more 
passive a role of the student has in class activities. As was pointed out 
in an earlier section, students are extremely accurate in making this estimate. 
Table 8 shows the range of teacher talk in Average and Gifted classes. Note 
the extremes of High and Low amounts of talk. 

The mode in Average classes is teacher talk 73% of class time; it is 60% 
in the two Gifted groups. However, the teacher talks less than half the time 
in 1/9 (12%) of the Average classes, 1/5 (21%) of the Gifted Reimbursement 
classes, and 1/3 (35%) of the Gifted Demonstration classes. 

TABLE 8 

PERCENTAGE OF CLASSES WITH HIGH TO LOW AMOUNTS OF TEACHER TALK 
(Based on the median student estimate of teacher talk per class.) 

Teacher Talk During Class Time Percentage of Classes in Each Group 





Average 


Reimbursement 


Demonstration 


High {75-90% teacher talk 1 


55% 


43% 


6% 


60% 


33% 


36% 


59% 


40% 


9% 


7% 


14% 


Low (10-25% teacher talk) 


3% 


14% 


21% 




100% 


100% 


100% 




(N-69) 


(N=28) 


(N=34) 



There is a dramatic decrease in teacher talk from Average to Gifted Demon- 
stration classes ■ The percentage of classes in which an extremely low 
amount of teacher talk prevails increases sharply from Average to Demonstra- 
tion classes. 
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Preparation for Cla ss 



Students estimated the amount of time each week they spent preparing 
for class « Bear in mind that their estimate concerns only one of five to 
seven or more subjects for which homework could be expected. Some of the 
preparation might be voluntary instead of required work. Table 9 shows 
the amount of time sp^nt preparing for class weekly for Average and Gifted 
classes. 



TABLE 9 

T I ME SPENT' PREPARING FOR CLASS EACH WEEK IN AVERAGE AMD GIFTED CLASSES 
(Based on the median student estimate for each class.) 



Hours of Preparation 
Time Each Week 


Sample of 
Average Classes 
(N=69) 


Sample of Gifted 
Reimbursement Classes 
(N=28) 


Sample of Gifted 
Demonstration Classes 
(N=34) 


Less than 1 hour 


10% 


0% 


35% 


From 1 to 2 hour. 1 , 


67% 


43% 


44% 


More than 2 hour; 


23% 


57% 


21% 



It can te noted in the Table that students in a large proportion of 
classes in all three groups spend from 1 to 2 hours per week on homework of 
some kind, Ihis is somewhat less than one-half hour each evening. The twv 
Gifted groups show some variation from this pattern, but in opposite direc 
tions. The rrajority of students in Gifted Reimbursement classes spend more 
than 2 hours a week preparing for class. Gifted Demonstration students in 
over one-:hiid of the classes spend less than one hour per week on outside 
preparation. It is difficult to account for this difference without infor- 
mation on the nature of outside-of-c lass activities, 
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Summary 



Based on the C 1 a 1 > ^ Activities Questionnaire, significant differences 
are found between Average and Gifted Illinois classes in the degree of em- 
phasis on higher thought processes, classroom focus, and classroom climate 
Significant differences are also noted between Average and Gifted classes 
on the statistical factors of "Application, Synthesis, Enthusiasm, and 
Independence" and "Memory and Test/Grade Stress." 

Specifically the following differences are noted: 



Average Classes 

1 Most classes emphasize few 

(2 or less) thought processes, 

2. Most classes emphasize only 
one (if any) of the higher 
thought processes, 

3. As a group, Average classes 

emphasize 3 of the 7 levels 
of thinking: Translation, 

Interpretation, Analysis. 

4. A higher amount of teacher talk 
occurs . 

5. Classes have 1 itt le oppor- 
tunity for or involvement 
in discussion, 

6. Test/grade stress is char- 
acteristic of Average classes 
as a group. 

7. There is an absence of enthu- 
siasm in a majority of the 
classes . 

8. There is opportunity for 
independence in a fourth of 
the classes. 



Gifted Classes 

1. Most classes emphasize many 
(3 or more) thought processes 

2. Most classes emphasize two 

or more of the higher thought 
processes . 

3. As a group, Gifted classes 
emphasize 6 of the 7 levels 
of thinking. 



4. A moderate amount of teacher 
talk occurs. 

5. Classes have much oppor- 
tunity for and involvement 
in discussion. 

6. Test/grade stress is not char 
acteristic of Gifted classes 
as a group. 

7. The presence of enthusiasm 
characterizes almost all 
classes, 

8 There is opportunity for 
independence in most Gifted 
c lasses . 
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